“Tenure can withstand Twitter”: we need policies that promote science communication and protect those who engage

In the age of social media, the professor’s podium has expanded. Cassidy R. Sugimoto argues so too must our policies on science communication and academic freedom. Academic freedom is a right for unfettered freedom to research, but also with an obligation to disseminate that research. Twitter and other social media can be used to fulfill this obligation. What we need now are policies that promote science communication with the public and protect those who engage in this discourse

Theories of Informetrics and Scholarly Communication

Scientometrics have become an essential element in the practice and evaluation of science and research, including both the evaluation of individuals and national assessment exercises. Yet, researchers and practitioners in this field have lacked clear theories to guide their work. As early as 1981, then doctoral student Blaise Cronin published The need for a theory of citing —a call to arms for the fledgling scientometric community to produce foundational theories upon which the work of the field could be based. More than three decades later, the time has come to reach out the field again and ask how they have responded to this call. This book compiles the foundational theories that guide informetrics and scholarly communication research. It is a much needed compilation by leading scholars in the field that gathers together the theories that guide our understanding of authorship, citing, and impact

A Systematic Identification and Analysis of Scientists on Twitter

Metrics derived from Twitter and other social media---often referred to as altmetrics---are increasingly used to estimate the broader social impacts of scholarship. Such efforts, however, may produce highly misleading results, as the entities that participate in conversations about science on these platforms are largely unknown. For instance, if altmetric activities are generated mainly by scientists, does it really capture broader social impacts of science? Here we present a systematic approach to identifying and analyzing scientists on Twitter. Our method can identify scientists across many disciplines, without relying on external bibliographic data, and be easily adapted to identify other stakeholder groups in science. We investigate the demographics, sharing behaviors, and interconnectivity of the identified scientists. We find that Twitter has been employed by scholars across the disciplinary spectrum, with an over-representation of social and computer and information scientists; under-representation of mathematical, physical, and life scientists; and a better representation of women compared to scholarly publishing. Analysis of the sharing of URLs reveals a distinct imprint of scholarly sites, yet only a small fraction of shared URLs are science-related. We find an assortative mixing with respect to disciplines in the networks between scientists, suggesting the maintenance of disciplinary walls in social media. Our work contributes to the literature both methodologically and conceptually---we provide new methods for disambiguating and identifying particular actors on social media and describing the behaviors of scientists, thus providing foundational information for the construction and use of indicators on the basis of social media metrics

Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature

Data collected by social media platforms have recently been introduced as a new source for indicators to help measure the impact of scholarly research in ways that are complementary to traditional citation-based indicators. Data generated from social media activities related to scholarly content can be used to reflect broad types of impact. This paper aims to provide systematic evidence regarding how often Twitter is used to diffuse journal articles in the biomedical and life sciences. The analysis is based on a set of 1.4 million documents covered by both PubMed and Web of Science (WoS) and published between 2010 and 2012. The number of tweets containing links to these documents was analyzed to evaluate the degree to which certain journals, disciplines, and specialties were represented on Twitter. It is shown that, with less than 10% of PubMed articles mentioned on Twitter, its uptake is low in general. The relationship between tweets and WoS citations was examined for each document at the level of journals and specialties. The results show that tweeting behavior varies between journals and specialties and correlations between tweets and citations are low, implying that impact metrics based on tweets are different from those based on citations. A framework utilizing the coverage of articles and the correlation between Twitter mentions and citations is proposed to facilitate the evaluation of novel social-media based metrics and to shed light on the question in how far the number of tweets is a valid metric to measure research impact.Comment: 22 pages, 4 figures, 5 table

The role of handbooks in knowledge creation and diffusion: A case of science and technology studies

Genre is considered to be an important element in scholarly communication and in the practice of scientific disciplines. However, scientometric studies have typically focused on a single genre, the journal article. The goal of this study is to understand the role that handbooks play in knowledge creation and diffusion and their relationship with the genre of journal articles, particularly in highly interdisciplinary and emergent social science and humanities disciplines. To shed light on these questions we focused on handbooks and journal articles published over the last four decades belonging to the research area of Science and Technology Studies (STS), broadly defined. To get a detailed picture we used the full-text of five handbooks (500,000 words) and a well-defined set of 11,700 STS articles. We confirmed the methodological split of STS into qualitative and quantitative (scientometric) approaches. Even when the two traditions explore similar topics (e.g., science and gender) they approach them from different starting points. The change in cognitive foci in both handbooks and articles partially reflects the changing trends in STS research, often driven by technology. Using text similarity measures we found that, in the case of STS, handbooks play no special role in either focusing the research efforts or marking their decline. In general, they do not represent the summaries of research directions that have emerged since the previous edition of the handbook.Comment: Accepted for publication in Journal of Informetric

What constitutes valuable scholarship? The use of altmetrics in promotion and tenure

The traditional ways in which promotion and tenure committees assess scholarship — whether quantitatively or qualitatively — are either inappropriate or insufficient for capturing its true value, argue Stacy Konkiel, Cassidy R. Sugimoto and Sierra Williams. Altmetrics can help fill in the knowledge gaps, but ultimately will only provide a limited view. Richer narratives can always be found by digging deeper into the qualitative data behind the metrics

Evaluating Reference Transactions in Academic Music Libraries

This study evaluates the quality of reference transactions in academic music libraries. The study builds on previous research that identified music libraries as having different evaluation needs than main, multidisciplinary academic libraries. Using unobtrusive evaluation techniques, this study analyzes chat/IM and e-mail reference transactions at 128 U.S. academic music libraries in order to determine the quality of responses provided. Differences in quality of responses between the two mediums are also analyzed. The results of this study provide a state-of-the-art view of the current media on which reference services are offered for music libraries, and the quality of those services. This work discusses the implications of the findings and provides suggestions for improving the quality of these reference services in academic music libraries

The institutionalized stratification of the Chinese higher education system

To promote research excellence, China’s government has been offering substantial financial support for a small group of selected universities through three national research programs (Project 211, Project 985, Double First Class). However, admission to these programs may not be completely merit based. Based on a statistical analysis of Chinese universities’ scientific activities, this paper shows that this institutionalized hierarchy is not supported by empirical data on research performance, which contributes to inequalities and inefficiencies in Chinese higher education. To build and maintain research capacity, China must support meritocracy across the research system

P-Rank: An indicator measuring prestige in heterogeneous scholarly networks

Ranking scientific productivity and prestige are often limited to homogeneous networks. These networks are unable to account for the multiple factors that constitute the scholarly communication and reward system. This study proposes a new informetric indicator, P-Rank, for measuring prestige in heterogeneous scholarly networks containing articles, authors, and journals. P-Rank differentiates the weight of each citation based on its citing papers, citing journals, and citing authors. Articles from 16 representative library and information science journals are selected as the dataset. Principle Component Analysis is conducted to examine the relationship between P-Rank and other bibliometric indicators. We also compare the correlation and rank variances between citation counts and P-Rank scores. This work provides a new approach to examining prestige in scholarly communication networks in a more comprehensive and nuanced way